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ABSTRACT 

A method for providing data indicative of the performance of a competing 
algorithm and an incumbent algorithm includes evaluating an incumbent-algorithm score 
indicative of a performance of an incumbent algorithm. The performance of a competing 
algorithm executing in place of the incumbent algorithm is then simulated. On the basis of 
the simulation, a competing-algorithm score predictive of a performance of the competing 
algorithm is evaluated. These scores are then provided to an output device. 


-15- 


